Skip to content

ci: wait for exact benchmark baselines - #9194

Draft
connortsui20 wants to merge 1 commit into
developfrom
ct/benchmark-baseline-wait
Draft

ci: wait for exact benchmark baselines#9194
connortsui20 wants to merge 1 commit into
developfrom
ct/benchmark-baseline-wait

Conversation

@connortsui20

@connortsui20 connortsui20 commented Aug 5, 2026

Copy link
Copy Markdown
Member

Benchmarks PR workflows at the synthetic merge commit (github.sha) and compares results only with the exact PR base commit. This stacks on #9197.

The reusable SQL workflow waits once for the base commit’s SQL jobs before matrix fan-out. It succeeds as soon as all SQL jobs succeed, fails immediately for a completed failed job, and otherwise waits for up to two hours while the develop workflow runs.

The non-SQL runners retry for up to 40 minutes while their exact base rows are published.

This deliberately keeps the merge-commit and exact-baseline policy separate from the focused benchmark labels and file-size reporting.

@codspeed-hq

codspeed-hq Bot commented Aug 5, 2026

Copy link
Copy Markdown

Merging this PR will not alter performance

✅ 1894 untouched benchmarks
⏩ 43 skipped benchmarks1


Comparing ct/benchmark-baseline-wait (416cf93) with develop (4030e01)

Open in CodSpeed

Footnotes

  1. 43 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@connortsui20
connortsui20 force-pushed the ct/benchmark-baseline-wait branch from 48231b4 to 7a2d053 Compare August 5, 2026 14:40
@connortsui20
connortsui20 changed the base branch from ct/benchmark-labels to ct/benchmark-zero-byte-reporting August 5, 2026 14:40
@connortsui20
connortsui20 marked this pull request as draft August 5, 2026 14:48
@connortsui20
connortsui20 force-pushed the ct/benchmark-baseline-wait branch from 7a2d053 to 50956dc Compare August 5, 2026 14:58
@connortsui20
connortsui20 force-pushed the ct/benchmark-baseline-wait branch from 50956dc to b2d1396 Compare August 5, 2026 16:13
Base automatically changed from ct/benchmark-zero-byte-reporting to develop August 5, 2026 17:56
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
connortsui20 force-pushed the ct/benchmark-baseline-wait branch from b2d1396 to 416cf93 Compare August 5, 2026 17:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant